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11  ABSTRACT 

The  objective  is  to  have  a  compact  inverse  representation  of  the  basis  of 
a  staircase  structure.  Every  other  step  in  the  staircase  is  assigned  to  a 
subsystem  partition  and  the  remaining  to  a  "master"  partition.  This  permits 
an  extension  of  the  generalized  upper-bounding  technique  to  be  applied.  After 
a  column  elimination,  the  resulting  working  basis  associated  with  the  "master" 
partition  turns  out  to  also  have  a  staircase  formate  but  with  half  the  number  of 
steps.  This  permits  reapplication  of  the  same  technique  recursively  until  the 
number  of  steps  of  the  p1"^  working  basis  has  only  one  step.  An  interesting 
aspect  of  the  procedure  is  that  a  number  of  operations  can  be  performed  in 
parallel  and  are  not  affected  by  a  change  in  basis. 
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SOLVING  STAIRCASE  LINEAR  PROGRAMS  BY  A 


NESTED  BLOCK-ANGULAR  METHOD 

by 

George  B.  Dantzig 

Block  angular  systems  can  be  solved  by  the  simplex  method  using 
a  compact  inverse  representation  of  the  basis.  The  method  is  a  direct 
extension  of  the  generalized  upper-bound  technique.  We  wish  to  apply 
this  result  to  staircase  systems.  To  do  this,  we  assign  every  other 
"step"  in  a  staircase  basis  structure  (1)  to  a  subsystem  by  rearranging 
the  rows,  the  result  is  as  in  (2). 


I 

I'  II 

II'  III 

(1)  III*  IV 

IV'  V 

V'  VI 


INITIAL  STAIRCASE  BASIS  STRUCTURE  R.H.S. 


Note  that  the  subsystem  consists  of  independent  sets  of 
equations  e.g.,  [I,  II],  [III^  IV]  and  [V,  VI],  so  that  it  is  in  the 
proper  form  for  applying  block-angular  techniques.  In  the  extension 
of  the  generalized  upper-bounding  technique  for  this  class  of  problems, 
a  column  operation  is  performed  to  reduce  the  columns  of  each  set, 

i 

like  [I  ,  II]  and  its  corresponding  right  handside  (R.H.S.)  to  the 
form  [B^,  0]  where  Bj^  is  any  non-singular  subset  of  columns 
of  [I1,  II]  which  we  will  refer  to  as  "key"  columns.  The  same  column 
operations  are  performed  on  the  corresponding  columns  of  the  master. 
After  the  operations,  the  master  part  has  a  new  format.  For  system  (2) 
the  result  is 


BASIS  AFTER  COLUMN  OPERATIONS 


R.H.S. 


The  important  point  to  note  that  the  inverse  of  matrix  (3)  can  be 

-1  -1  -1 

obtained  from  the  knowledge  of  B^  ,  ,  B^  and  the  inverse  of 


2 


I 


(4) 


I'  II 

IT'  TTT_ 


But  (4)  is  again  staircase  form  with  half  the  number  of  rows.  Thus  one 
is  now  in  a  position  to  recursively  re-apply  the  technique.  A  32  time 
period  model,  for  example,  would  require  5  recursions. 


Effect  of  Change  of  Basis.  Let  us  consider  a  T  *  8  period  staircase 
structure  (5).  Let  p  be  defined  by  2P  -  T,  i.e.,  p  =  log2  T. 


We  can  associate  with  the  various  rearrangements  and  column  operations 
a  heiarchy  of  staircase  systems: 
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Initial  Staircase 
System 


Circles  Indicate  that  on  the  initial  recursion  we  place  S^,  S^,  S°,  Sg 
in  the  subsystem  and  as  a  result  of  the  column  operations  S°,  S°,  S°,  S° 
are  modified  to  S*,  S*,  S*,  S^.  The  directed  arcs  pointing  to  S*, 
for  example^  indicate  that  S^  only  depends  on  S^,  S°,  S?,  i.e.,  only 
on  those  with  adjacent  subscripts  in  the  previous  recursion.  Suppose 

now  in  a  basis  change  only  Sg  is  modified.  It  will  cause  a  change 

12  3  l 

in  S^,  St  and  S^  but  the  remaining  S^  will  be  unmodified.  In 

general,  if  there  are  2P  steps  a  "local"  change  of  basis  can  be 
shown  to  affect  2(p+l)  of  the  S*.  However,  a  non-local  change  of 
basis  (such  as  the  introduction  into  the  basis  of  a  column  associated 
with  an  early  period  t^  and  dropping  a  column  of  a  later  period 
*"2  >  tl^  could  effect  less  than  4(p+l)  of  the  S^. 

Information  to  be  stored.  This  has  not  (at  this  writing)  been  completely 
analysed  but  is  less  than  twice  the  number  of  elements  in  the  arrays 
(assuming  are  composed  of  only  non-zero  coefficients)  plus 
the  storage  of  the  inverses  of  T  matrices  of  size  rat  x  mt  where  mfc 
the  number  of  equations  corresponding  to  the  t  step  of  the  staircase. 
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is 


Storage-wise  the  method  appears  to  be  competitive  with  the  best  of 
alternative  solution  techniques  that  have  been  proposed  so  far. 


A  Comparison  for  Square-Block  Staircase  Systems:  Suppose  we  have  system 
(1)  and  the  diagonal  submatrices  I,  II,  ...  ,  VI  are  each  square 
and  non-singular.  It  is  clear  in  this  case  we  could  efficiently  solve 
the  system  by  using  I  to  eliminate  I*,  use  II  to  eliminate  II',  etc. 
In  many  applications  of  staircase  systems  it  can  be  shown  that  non¬ 
singular  square  blocks  hold  along  the  diagonal  for  'Almost  all"  periods. 

It  is  of  interest  therefore  to  see  how  our  proposed  partitioning 
of  the  rows  into  a  subsystem  and  a  master  would  fare  as  an  alternative 
solution  procedure.  Note  that  in  (2)  we  are  assuming  II,  IV,  VI  are 
each  non-singular,  hence  if  we  use  these  as  key  submatrices  for  the 
elimination  of  columns,  the  result  corresponding  to  (4)  in  this  case 
would  be 


I 

(7)  I  III 

iTT  v 


Master 


Rearrangement  yields 
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Ill 


Master  within  the  master 


(8) 


i1 


I 


V 


Subsystem  within  the  master 


Column  Elimination  using  non-singular  V  yields  finally 

(9)  III 

Thus  there  is  no  disadvantage  using  the  proposed  technique  even  for 
the  case  of  square  block  systems.  Indeed  there  is  an  advantage, 
because  a  change  of  basis  generates  only  local  changes  affecting  only 
2(p+l)  out  of  2*2^  of  the  submatrices  generated  by  the  process 
for  the  case  where  the  number  of  steps  in  the  3taircase  is  T  ■  2P. 

Parallel  Processing.  Some  of  the  recent  designs  for  computers  possess 
extensive  parallel  processing  features.  The  proposed  solution  method 
could  be  efficiently  handled  on  such  machines  because  they  could  do 
parallel  processing  of  every  other  step  and  then  recursively  in 
parallel  for  a  system  half  the  size  etc.  Updating  would  proceed  in 
an  analogous  parallel  manner  except  (as  indicated  in  our  analysis  of 
(5)  and  (6))  many  of  the  sub-matrices  being  processed  in  parallel  would 
require  no  change  in  the  updating.  Thus  a  parallel  process  machine 
would  be  very  efficient  for  obtaining  the  initial  compact  inverse 
representation  or  a  subsequent  complete  update  but  would  probably 
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have  little  advantage  for  the  iterative  updating  of  the  inverse 
representation  when  there  is  only  a  simple  one  column  change  in  the 


basis 


